Papers with multimodal translation task
Multilingual and Multimodal Learning for Brazilian Portuguese (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing models that learn multimodal and multilingual representations perform better in many natural language tasks. |
| Approach: | They use a multimodal and multilingual corpus to test its generalization ability for other languages . they achieve a BLEU score of 51.8 and a METEOR score of 78.0 on the test set . |
| Outcome: | The proposed model outperforms the existing model on a Portuguese-English multimodal translation task. |
Cross-lingual Visual Verb Sense Disambiguation (N19-1)
Copied to clipboard
| Challenge: | Recent work has shown that visual context improves cross-lingual sense disambiguation for nouns. |
| Approach: | They extend their work to the task of cross-lingual verb sense disambiguation by using a dataset annotated with English, German, and Spanish verbs. |
| Outcome: | The proposed model improves the results of a text-only machine translation system when used for a multimodal translation task. |